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DETAILED ACTION 
Response to Arguments 

1 . Regarding tine rejections to claims 10-18 under 35 U.S.C. 101 made in the 
previous Office Action, the amendment to the specification has removed the 
"propagated signal" language. Information carriers are now defined as including 
machine readable storage devices (page 12 of the specification), and are further 
defined to include all forms of non-volatile memory (such as CD-ROMS, etc., page 13 of 
the specification). Since the term "information carrier" now excludes non-statutory 
embodiments such as a carrier signal, the rejections to claims 10-18 under 35 U.S.C. 
101 are withdrawn. 

2. Regarding Applicant's arguments with respect to the prior art rejections, 
independent claims 1 and 10 have been amended to include a caching process at the 
speech animation engine. While Ostermann et al. do not disclose such a feature, 
Trower II et al. (U.S. Patent 5,983,190) previously submitted in an IDS on February 25 
2005) discloses a speech animation engine which includes the caching process 
claimed. Further, It would have been obvious to one of ordinary skill in the art at the 
time of invention to modify Ostermann et al. to include a caching process, because 
these greatly increase the overall performance of an animation system. Thus, claims 1- 
18 remain rejected for the reasons given below. 
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Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 

forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-5, 7-14, and 16-18 are rejected under 35 U.S.C, 103(a) as being 
unpatentable over Ostermann et al. (U.S. Patent 6,963,839), in view of Trower II et al. 
(U.S. Patent 5,983,190). 

In regard to claim 1, Ostermann et al. disclose a system (Fig. 4A), comprising: 
a speech animation engine (animation server 68, column 5, lines 7-12); and 
a client application in communication with the speech animation engine (client 
application 64, column 4, lines 54-59), 

wherein the client application is operable to perform the following operations: 

sending a request for speech animation to the speech animation engine, 
the request identifying data to be used to generate the speech animation (text 
with emoticons and other parameters is sent to animation server 68 to generate 
an animation that matches the text, column 5, lines 7-26), the speech animation 
being speech synchronized with facial expressions (animated characters are 
generated that appear to speak the submitted text message, column 5, lines 26- 
36); 

receiving a response from the speech animation engine, the response 
identifying the generated speech animation (the animated message is returned to 
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the client, column 5, lines 37-52; by pointing to the appropriate location, column 
7, lines 5-13); and 

using the generated speech animation to animate a talking agent 
displayed on a user interface of the client application (the animated message is 
displayed to the client for viewing, column 7, lines 8-13); 
and wherein the speech animation engine is operable to perform the following 
operations: 

receiving the request for speech animation from the client application 
(animation server 68 receives the sender message, column 5, lines 7-17); 

retrieving the data identified in the request without user intervention (the 
animation server 68 processes the received sender message without 
intervention, column 5, lines 18-22); 

generating the speech animation using the retrieved data (the sender 
message is used to generate an animated message, column 5, lines 22-26); and 

sending the response identifying the generated speech animation to the 
client application (the animated message is returned to the client, column 5, lines 
37-52; by pointing to the appropriate location, column 7, lines 5-13). 
Ostermann et al. do not disclose checking the request against a cache of 
previous requests; 

retrieving the speech animation from a shared storage of previously generated 
speech animations if the request is identical to a previous request; 
storing the request in the cache of previous requests; 
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generating tine speech animation using the retrieved data if the request is not 
identical to a previous request; and 

storing the generated speech animation to the shared storage. 

Trower II et al. disclose a speech animation system (see abstract) wherein a 
speech animation engine (Fig. 3, animation server 100, column 5, line 65 to column 6, 
line 6) is operable to perform the following operations: 

retrieving the speech animation from a shared storage of previously generated 
speech animations if the request is identical to a previous requests (Fig. 6, a cache is 
checked for previously generated frames in step 200; if the current frame is equal to a 
previously generated frame, the constructed frame that is already in the cache is 
returned, column 9, lines 32-44); 

storing the request in the cache of previous requests (the most recently used 
frame ID is stored in the data cache, column 9, lines 36-39) ; 

generating the speech animation using the retrieved data if the request is not 
identical to a previous request (if there is no matching frame ID in the data cache, the 
animation is generated in steps 204-208, column 9, lines 44-57); and 

storing the generated speech animation to the shared storage (the generated 
animation is saved in the cache, column 57-60). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Ostermann et al. to include the caching process as taught by Trower 
II et al., because data caching in a speech animation engine "significantly improves the 
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overall performance of the animation system", as taught by Trower II et al, (column 9, 
lines 39-41). 

In regard to claim 2, Ostermann et al. disclose retrieving the data includes 
retrieving the data in real time (messages are processed in real time, column 6, lines 
37-59). 

In regard to claim 3, Ostermann et al. disclose the data specifies text to be used 
to generated the speech animation (text with emoticons and other parameters is sent to 
animation server 68 to generate an animation that matches the text, column 5, lines 7- 
26). 

In regard to claim 4, Ostermann et al. disclose the text includes variable 
elements (emoticons and other parameters, column 5, lines 7-26). 

In regard to claim 5, Ostermann et al. disclose the data specifies a voice to be 
used to generate the speech animation (the user selects a voice to be used, column 8, 
line 59 to column 9, line 6). 

In regard to claim 7, Ostermann et al. disclose the request further identifies 
context information taken from a live session of the client application (during a live 
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instant messaging session, context information about tine user's identity is included, 
column 6, lines 60-65); and 

generating the speech animation includes incorporating the context information 
into the generated speech animation (when participant send their message, the 
corresponding character is animated, column 6, line 65 to column 7, line 4). 

In regard to claim 8, Ostermann et al. disclose the context information includes 
information about a user of the client application (the identity of the user, column 6, lines 
60-65). 

In regard to claim 9, Ostermann et al. disclose the client application is a web 
application (HTML client, column 4, lines 54-64); and 

the request is an HTTP request (the request is sent over the Internet 62, thus the 
request must inherently be an HTTP request, column 5, lines 7-12). 

In regard to claim 10, Ostermann et al. disclose a computer program product, 
tangibly embodied in an information carrier, the computer program product being 
operable to cause data processing apparatus to perform operations (Fig. 4A, the 
animation server 68 executing computer code must necessarily comprise a computer 
program product containing the code) comprising: 

receiving a request from a client application for speech animation, the request 
identifying data to be used to generate the speech animation, the speech animation 
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being speech synchronized with facial expressions (text with emoticons and other 
parameters is sent to animation server 68 to generate an animation that matches the 
text, column 5, lines 7-26); 

retrieving the data without user intervention (the animation server 68 processes 
the received sender message without intervention, column 5, lines 18-22); 

generating the speech animation using the retrieved data (the sender message is 
used to generate an animated message, column 5, lines 22-26); and 

sending a response identifying the generated speech animation to the client 
application (the animated message is returned to the client, column 5, lines 37-52; by 
pointing to the appropriate location, column 7, lines 5-13). 

Ostermann et al. do not disclose checking the request against a cache of 
previous requests; 

retrieving the speech animation from a shared storage of previously generated 
speech animations if the request is identical to a previous request; 

storing the request in the cache of previous requests; 

generating the speech animation using the retrieved data if the request is not 
identical to a previous request; and 

storing the generated speech animation to the shared storage. 

Trower II et al. disclose a speech animation system (see abstract) wherein a 
speech animation engine (Fig. 3, animation server 100, column 5, line 65 to column 6, 
line 6) is operable to perform the following operations: 
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retrieving tine speecli animation from a shared storage of previously generated 
speech animations if the request is identical to a previous requests (Fig. 6, a cache is 
checked for previously generated frames in step 200; if the current frame is equal to a 
previously generated frame, the constructed frame that is already in the cache is 
returned, column 9, lines 32-44); 

storing the request in the cache of previous requests (the most recently used 
frame ID is stored in the data cache, column 9, lines 36-39) ; 

generating the speech animation using the retrieved data if the request is not 
identical to a previous request (if there is no matching frame ID in the data cache, the 
animation is generated in steps 204-208, column 9, lines 44-57); and 

storing the generated speech animation to the shared storage (the generated 
animation is saved in the cache, column 57-60). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Ostermann et al. to include the caching process as taught by Trower 
II et al., because data caching in a speech animation engine "significantly improves the 
overall performance of the animation system", as taught by Trower II et al. (column 9, 
lines 39-41). 

In regard to claim 1 1 , Ostermann et al. disclose retrieving the data includes 
retrieving the data in real time (messages are processed in real time, column 6, lines 
37-59). 



Application/Control Number: 10/796,242 Page 10 

Art Unit: 2626 

In regard to claim 12, Ostermann et al. disclose the data specifies text to be used 
to generated the speech animation (text with emoticons and other parameters is sent to 
animation server 68 to generate an animation that matches the text, column 5, lines 7- 
26). 

In regard to claim 13, Ostermann et al. disclose the text includes variable 
elements (emoticons and other parameters, column 5, lines 7-26). 

In regard to claim 14, Ostermann et al. disclose the data specifies a voice to be 
used to generate the speech animation (the user selects a voice to be used, column 8, 
line 59 to column 9, line 6). 

In regard to claim 16, Ostermann et al. disclose the request further identifies 
context information taken from a live session of the client application (during a live 
instant messaging session, context information about the user's identity is included, 
column 6, lines 60-65); and 

generating the speech animation includes incorporating the context information 
into the generated speech animation (when participant send their message, the 
corresponding character is animated, column 6, line 65 to column 7, line 4). 
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In regard to claim 17, Ostermann et al, disclose the context information includes 
information about a user of the client application (the identity of the user, column 6, lines 
60-65). 

In regard to claim 18, Ostermann et al. disclose the client application is a web 
application (HTML client, column 4, lines 54-64); and 

the request is an HTTP request (the request is sent over the Internet 62, thus the 
request must inherently be an HTTP request, column 5, lines 7-12). 

5. Claims 6 and 15 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ostermann et al., in view of Trower II et al., and further in view of Phillips (U.S. Patent 
6,507,811). 

In regard to claims 6 and 15, Ostermann et al. and Trower II et al. do not disclose 
the data specifies a pool of synonyms; and 

generating the speech animation includes selecting a synonym from the pool of 
synonyms. 

Phillips discloses a system and computer program product for generating 
messages, wherein a user: 

specifies a pool of synonyms (a list of one or more synonyms, column 6, lines 49- 
58); and 

selecting a synonym from the pool of synonyms (one of the list of synonyms is 
selected at random to be included in the message, column 6, lines 58-63). 
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It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Ostermann et al. and Trower II et al. to allow the user to specify a 
pool of synonyms and then select one of the synonyms during generation of the speech 
animation, because randomly selecting a synonym for inclusion in a message provides 
a highly amusing affect, as taught by Phillips et al. (see Abstract). Especially in the 
context of sending animated messages, one of ordinary skill in the art would be 
motivated to add features, such as selecting a synonym from a pool of synonyms, which 
would increase the amusement value of the animated messages. 

Conclusion 

6. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
GFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 GFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 
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7. Any inquiry concerning tiiis communication or earlier communications from the 
examiner should be directed to BRIAN L. ALBERTALLI whose telephone number is 
(571)272-7616. The examiner can normally be reached on Monday-Thursday, 8 AM to 
6:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Hudspeth can be reached on (571) 272-7843. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/David R Hudspeth/ 

Supervisory Patent Examiner, Art Unit 2626 

BLA 9/11/08 



